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The second law of ordinary thermodynamics and the second law of steady state thermodynamics, 
as proposed by Oono and Paniconi, are investigated from the microscopic point of view for the 
open quantum system. Based on the H-theorem of Lindblad, we show that both second laws 
are consistent with the quantum dynamics generated by the completely positive map. In addition, 
microscopic expressions of entropy production and "housekeeping heat" are obtained for some classes 
of dynamical quantum systems. 
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Understanding the properties of nonequilibrium states 
of quantum systems may become important for develop- 
ing quantum devices which perform efficiently in nonequi- 
librium situations; It is known, for instance, that quan- 
tum ratchet systems only work in competitive situations 
between thermal relaxation and external driving||l|, |[ |j. 
A theoretical framework for considering the general prop- 
erties of nonequilibrium states, however, is still under de- 
velopment. 

In this letter we focus our attention on thermodynamic 
properties of steady states in nonequilibrium quantum 
dynamics, especially the second law of steady state ther- 
modynamics. The steady state thermodynamics (SST) 
proposed by Oono and Paniconi is a phenomenological 
thermodynamic framework for the steady state instead of 
thermal equilibrium. The second law of SST is not sim- 
ple because the steady state produces heat constantly; 
In such a situation the total heat is divergent. There- 
fore the meaning of heat in the second law of SST is 
ambiguous. Oono and Paniconi introduced a concept of 
"excess heat" to resolve this confusing situation. The ex- 
cess heat is defined by subtracting "housekeeping heat" 
from the total heat; The housekeeping heat is defined as 
the energy preventing steady states from thermal relax- 
ation. Then the excess heat for the steady state becomes 
finite and we can discuss the second law with this ex- 
cess heat. There are still ambiguities; How do we de- 
termine other thermodynamic quantities operationally? 
What are microscopic expressions of such quantities? In 
this letter we consider microscopic quantum descriptions; 
Especially we treat some classes of small open quantum 
systems and thermodynamic processes for such systems. 
As a consequence we discuss the second law of SST for 
nonequilibrium quantum dynamics of small open quan- 
tum systems. 

Our strategy is as follows: First we clarify how 
the equilibrium thermodynamics is consistent with the 
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nonequilibrium quantum dynamics. Next we extend this 
result to the nonequilibrium steady state case. Mathe- 
matically this operation has no ambiguity for some lim- 
iting class of the system. Finally we discuss the validity 
of our expression. 

The present quantum system we consider consists of 
three parts; One is a main system with a time-varying 
field. This part is operated from the outside. The time- 
varying field acts like, for instance, a piston in a cylinder. 
Our interest is concentrated on this part. We write its 
Hamiltonian as H{t) or H\ explicitly representing the 
time-dependent field \{t). Here we assume that the sys- 
tem is sufficiently small. The second part of the whole 
system is a heat bath. It is so large that it is always 
in thermal equilibrium with a definite temperature (we 
denote its inverse temperature as j3). The last part is 
an interaction between the first two. The coupling con- 
stant 7 governs the relaxation time of the system. In the 
present study we assume that the coupling is sufficiently 
weak. This assumption ensures the independency of the 
small system from the heat bath. Then we can discuss 
the thermodynamic properties of the small system. It 
should be noted that a temperature of the small system 
cannot be defined in its nonequilibrium state. We only 
mention its temperature in the thermal equilibrium state 
by the corresponding heat bath temperature /3. 

A thermodynamic process for the present study is de- 
scribed in the following way; At the initial time, a density 
operator of the small system is taken to be in thermal 
equilibrium. From this state we operate the field A from 
to 1 (these values can be chosen arbitrary without loss 
of generality) in the finite time interval T. The value 
of T controls a property of the dynamics; If T is suffi- 
ciently shorter than the characteristic time determined 
by the minimal energy gap at the pseudo crossing of en- 
ergy levels, the process may become nonadiabatic [ ISj in 
the quantum mechanical sense. If T is sufficiently larger 
than the above time scale but much smaller than the ther- 
mal relaxation time (~ 0(7"^)), the adiabatic dynamics 
may be actualized. If T is much larger than all the above 
mentioned time scales, the dynamics becomes a quasi- 
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equilibrium. Then the system is always in the thermal 
equilibrium state corresponding to the Hamiltonian H^. 

The microscopic dynamics of the system we use here 
is obtained by a projection method||5|]. After applying 
the projection method and weak coupling expansion, we 
obtain the equation of motion for the density operator 
p{t) of the system as follows: 



dpjt) 
dt 



-[i7(i),pW]-7'r^(t)(p(t)) 



(1) 



The first term represents pure quantum dynamics. The 
second term is a thermal relaxation term; If the Hamilto- 
nian is independent of time, the system relaxes into the 
thermal equilibrium state. The result of this letter is, 
however, independent of the details of dynamics. Only 
the (1) existence of the equilibrium or nonequilibrium 
steady states and the (2) special features of the dynam- 
ics mentioned in latter part is important. 

Let us define thermodynamic quantities in the present 
situation. First we define the internal energy. It can 
be regarded as the expectation value of the Hamilto- 
nian under the assumption that the system is small. In 
the present thermodynamic process we can write a total 
change of the internal energy AE as 



A dt 



{Hi)t — {Ho)o 



where A is the time derivative of A and (. . . )t represents 
Tr(...p(t)). 

The total work W done by the external field during 
the process is defined as 



W = 



dt ' 



that is, the work is the summation of the average value 
of the change of the Hamiltonian with respect to A[|[ 0. 
This definition of work is dependent on the thermody- 
namic process in contrast to the change of the internal 
energy. 

Using AE and W, we can define the "heat" AQ in this 
context as 

AQ = AE-W . 

This quantity represents the net energy coming from the 
heat bath. It is written by microscopic variables as 



AQ 



dX 



( dpjt) 



^Tr(--lnp-W 



where p^«(t) = exp (-/3i7(i)) /Trcxp is the 

thermal equilibrium density matrix. 

The definition of the entropy is not clear, because the 
entropy is a concept in an equilibrium state, not a dynam- 
ical state. Therefore we need some definitions of entropy. 
Here we use the von Neumann entropy: 



S{t) = -Trp(t)lnp(f) 



(2) 



This definition is consistent with the equilibrium sta- 
tistical mechanics. However it is not trivial whether 
this is valid for nonequilibrium dynamical states; For in- 
stance, the von Neumann entropy neither increases nor 
decreases for any nonadiabatic process represented by 
unitary evolutions, even though classical thermodynam- 
ics states that the entropy increases. In order to treat 
this paradoxical situation, one frequently takes the par- 
tial trace for the microscopic degrees of freedom [Q. This 
process is called a "coarse-graining" . In the present case, 
the explicit coarse-graining is not suitable because the 
system has a few degrees of freedom; It is not clear which 
degrees of freedom are traced out. Instead, because of the 
non-unitary evolution, the effect of the coarse-graining is 
introduced naturally in Eq. (||) . We obtain the change of 
entropy during the process as 

AS^ l' ^ SiT) - SiO) . 



(3) 



/o A dt 

Now we can write the energy conservation as 
1 



{AS - Ae) = AQ 



where Ae is calculated as 
dX^ dp 



Ae = I^'^Tt^ [In p'^^t)- In Pit)) 



(4) 



Equation (|3|) is the ordinary first law of thermodynamics 
without Ae. We can easily show that Ae becomes zero in 
the quasi-equilibrium or the non-adiabatic limits. There- 
fore nonzero values of Ae represent the irreversibility of 
the dynamics. We call Ae "entropy production" . 

If the non-negativity of Ae can be proved, we obtain 
the following inequality: 



^AS > AQ 



(5) 



This form is quite similar to the original Clausius inequal- 
ity. But there is an essential difference. In the original 
one the entropy difference is is one of two thermal equi- 
librium values. By contrast AS* in Eq. is a dynamical 
value dependent on the process connecting two states. In 
addition there is no necessity that these two states are 
equilibrium states. 

Let us consider the non-negativity of the entropy pro- 
duction rate e = Tr {p (Inp'^'^(t) — Inp(t))) instead of the 
entropy production. Roughly speaking, this term can be 
non-negative; If the current density operator is "larger" 
("smaller") than one corresponding to the equilibrium 
state, the part \iip'^'^{t) — In p{t) is "less" ("grater") than 
0. If the system has normal thermodynamic stability, we 
can expect that the derivative p is negative (positive) at 
the same time. In this way, e becomes non-negative. 

For a more precise discussion, we define the following 
quantity: 

dipi , P2) = Trpi (In pi - In P2) 
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for two arbitrary density operators pi , P2 • This quantity 
is known as a quantum relative entropy or a quantum 
KuUback divergence §, which is a kind of distance be- 
tween pi and p2- We can prove that the above quantity 
is always non-negative. If and only if pi — p2, d(pi,p2) 
vanishes. Using d, we naively rewrite e as 

e = hm 1 [d{pit),p-^t)) - d{p{t + dt),p^'^m . 

at— ►O at 

Therefore the non-negativity condition of e becomes 

d{pit + dt),p'^^it))<dip{t),p'^^t)) (6) 

for sufficiently small positive dt{^ T). 

In 1975, Lindblad proved that the above inequality for 
more general cases His statement is as follows: For 
a completely positive map K, the inequality 

d[Kpi,Kp2)<d{pup2) (7) 

holds p6| . Here pi and p2 are some density matrices of 
the system. The completely positive map is a trace- 
preserving linear map keeping the positivity of the den- 
sity matrices. The statement "completely" means that 
the dynamics of the system cannot be influenced by the 
outside and cannot influence the outside. For example, 
a simple unitary evolution is a completely positive map. 
A projected map of the unitary evolution is also a com- 
pletely positive map. 

Here we sketch the outlines of his proof. It is based on 
the following two things: (1) the joint convexity of the 
relative entropy jlH, 

d(^\iP,,,'^\ai) <'^\d{p^,ai) , (8) 

i i i 

where pi,ai are two density matrices and Xi are non- 
negative numbers restricted by = 1; (2) the 
decomposition of the completely positive map K by the 
unitary evolution U ; 

Kp^Y.^^(^^U^PU ^ (9) 

u 

wheieY^jjKiU) = 1, K{U) > 0. If we substitute Eq. (|) 
into the left hand side of inequality and use the prop- 
erties of the coefficients K{U) and the joint convexity of 
d, we get Lindblad's H-theorem. 

In the present case our dynamics is written as a com- 
pletely positive mapfl^, If we choose pi as p{t), p2 as 
p'"^{t) and K as the infinitesimal time-evolution operator 
of the system we get 

d($fp(t),$fp^«(t))<d(p(t),p^^(t)) . 

Since the instantaneous thermal equilibrium state p'^''(t) 
is the invariant state of the map at time t, we obtain the 
inequality (^). Therefore the inequality holds. 

We emphasize again that the dynamical Clausius in- 
equality (ra) is dependent on a process which changes the 



parameter A. If we want to discuss the second law of ther- 
modynamics, we have to compare the present entropy 
change AS' with the quasi-equilibrium change of the en- 
tropy ASqs- The latter is only dependent on the two 
equilibrium distributions of the system with A = 0, 1. To 
get the usual second law, we start from the thermal equi- 
librium state with A = and leave the system after the 
switching process with A = 1 fixed. After relaxation, the 
quantities AS" and AE converge into quasi-equilibrium 
differences ASqs and AEqs- But the work W does not 
change. Then we get the Clausius inequality: 

^ASq, > AEqs - W . 

Let us consider the second law of steady state thermo- 
dynamics based on the knowledge of the previous consid- 
eration; Key points are the existence of the fixed point 
density matrix for the time-evolution map and Lindblad's 
H-theorem. Mathematically it is not important whether 
the fixed point is a thermal equilibrium state or not. If 
there is a nonequilibrium steady state described by p** (t) , 
the system may relax into this state, not into the equilib- 
rium state p'^'^{t). In such case, we can obtain a second- 
law analogue for the steady state by substituting p^'^{t) 
with p^'^it), which is generally dependent on time. Then 
we obtain the expression of the entropy production as 

^^ = iT^'(t -'"""») 

+ ryTr('|5(l„p"(<)-l»P"W)) ■ (10) 

We define an entropy production for the steady state as 

A6- ^ £ ^Tr (^^ (Inp-(t) - Inp(t))) (11) 

and define the difference of the "housekeeping" heat dur- 
ing the process as 

(12) 

The housekeeping heat is consumed to keep the system 
in the steady state, and prevent it form thermal relax- 
ation. In the quasi-steady limit, the density operator 
p{t) always follows p^*(t). Then AQhk can be regarded 
as the entropy production for the equilibrium state which 
is non-negative. 

The corresponding first law is obtained as follows: 

^{AS~Aen^^Q + ^Qhk . (13) 

In the present case we can expect that the entropy pro- 
duction for the steady state is non-negative. Therefore 
the following new inequality 

lAS>AQ + AQhk (14) 
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holds. This inequaHty is the second law of thermody- 
namics for the steady state in our present situation. 

Next we will look at other expressions for the house- 
keeping heat and consider its properties. We denote the 
steady state as p'^it) = exp{-l3{H{t) + <j){t)))/Z'''{t) 
with the steady state partition function = 
Tr exp(— /3(_ff(t) +(t){t))). (t){t) represents the nonequilib- 
rium part of Hamiltonian. Then the housekeeping heat 
can be written as a fluctuation form: 

where (. . . represents Tr(. . . p'^''^{t)), or more simply 

In the quasi-steady cyclic process, the differences of en- 
tropy, energy, and entropy production for the steady state 
vanish. In this case, normal work and "^-work" is bal- 
anced, that is, 

Jo X\dt/^'J„ x\dt/^ ■ 

This condition imposes some restrictions on the determi- 
nation of the nonequilibrium part of 4>{t). 

It is of note that AQhk is the difference of housekeep- 
ing heat for the dynamical process. If the density ma- 
trix does not depend on time, AQhk as defined above 
is strictly zero. Therefore we should consider that the 
present definition of housekeeping heat describes the dy- 
namical part of total housekeeping heat; The remaining 
housekeeping heat cannot be calculated with the above 



definition, because it is stationary with respect to time. 
This is not surprising, since our system is dynamical. We 
assume that the work done by outside is mechanical and 
dependent on time. Using this type of work, we cannot 
realize a stationary nonequilibrium steady state accom- 
panied by housekeeping heat. We only achieve making 
time-dependent nonequilibrium steady states like a limit 
cycle or stationary nonequilibrium states without house- 
keeping heat. 

To treat the stationary nonequilibrium steady state, 
we have to take into account the nonequilibrium bound- 
ary conditions such as thermal gradients or chemical po- 
tential gradients. In the present situation, however, this 
cannot be described by our definition of work. Therefore 
we need other expressions of thermodynamic quantities. 
If we obtain these expressions, the corresponding first 
and second laws may be obtained. But this is outside 
our scope to deal with that matter in this letter. 

To summarize, we have shown that the second law of 
thermodynamics is consistent with microscopic quantum 
dynamics of open systems. In addition, for the steady 
state thermodynamics, it is also true that the second law 
in the steady-state-based thermodynamic process of the 
open quantum system exists. In this letter we have stud- 
ied the second laws for the limited classes of open quan- 
tum system and dynamics. But similar discussions for 
some other systems, for instance, one with nonequilib- 
rium boundary conditions, may be possible. Especially 
for classical Markov systems, the present argument is di- 
rectly applicable with slight modifications jl^. For the 
classical Langevin system, the second law of SST also 
holds'. 
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